Character recognition

ABSTRACT

Systems and methods for character recognition by performing lateral view-based analysis on the character data and generating a feature vector based on the lateral view-based analysis.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. application Ser. No.13/755,728, filed Jan. 31, 2013, now U.S. Pat. No. 8,644,616, which is acontinuation of U.S. application Ser. No. 12/756,612, filed Apr. 8,2010, now U.S. Pat. No. 8,391,602.

BACKGROUND

Text recognition is known. The current state of the art generally isbased on computational models and tools that work on the entire scannedtext image stored in the system. That is, typically every scanned pixelof the text is used for text recognition. This typically requires alarge amount of space for storage. Further, these methods are timeconsuming as computation and processing for character recognition andclassification takes place using a large amount of data.

Automatic recognition of Asian characters may be a challenge. There havebeen some efforts to explore methods using top and bottom views ofscanned text. However, these top and bottom methods have not beensuccessful for many Asian languages that use ‘Matra’. A Matra is arunning horizontal line along the top of the characters. This horizontalline reduces the usefulness of the top view for character recognition ofthe text of many Asian languages. This is because the top view of manycharacters in these languages is exactly the same.

The Matra is prevalent and typical in many Asian languages, includingBengali, and Hindi, etc. Other languages for which character recognitionis difficult include traditional Mongolian script and its offshoots likeManchu that are written vertically.

Other difficulties effecting the ability to correctly recognize eventyped language symbols is the complex irregularity among the charactersfor different languages, fonts, styles and size. This irregularitywidens when one deals with handwritten characters or widely varyingfonts of a given language.

SUMMARY

The embodiments herein relate to a method comprising acquiring characterdata comprising one or more characters, the one or more charactershaving a first contour and a second contour, performing lateral viewanalysis on the character data, generating a feature vector based on thelateral view analysis, and identifying the one or more characters. Inone aspect, performing lateral analysis comprises selecting a number ofcharacteristic points, dividing the one or more characters into a numberof horizontal segments, the number of segments equal to the number ofcharacteristic points, and locating characteristic points on the firstand second contours, wherein a characteristic point is located in eachsegment on both the first and second contours. In another aspect, anorigin is located at a lower left of the one or more characters andwherein the characteristic points on the first contour are located at aminimum distance from a vertical axis rising from the origin and thecharacteristic points on the second contour are located at a maximumdistance from the vertical axis.

In another aspect, the horizontal segments have the same height. Inanother aspect, the method further comprises binarizing the characterdata. In another aspect, the method further comprises removing noisefrom the character data. In another aspect, the method further comprisesperforming oblique/skew detection. In another aspect, the method furthercomprises segmenting the character data into individual characters, thecharacter data comprising a plurality of characters. In another aspect,the contour data is not thinned. In another aspect, identifying the oneor more characters comprises using an artificial neural network. Inanother aspect, the method is adapted to recognize cursive characters.In another aspect, the method is substantially font invariant. Inanother aspect, the method is configured to identify characters in fontshaving variable character widths. In another aspect, the feature vectorcomprises the minimum distance of the characteristic points on the firstcontour, the maximum distances of the characteristic points on thesecond contour, the width of the character, and the height of thecharacter.

Another embodiment relates to a system comprising a microprocessor and amemory, the memory comprising computer executable instructions foracquiring character data comprising one or more characters, the one ormore characters having a first contour and a second contour, performinglateral view analysis on the character data, generating a feature vectorbased on the lateral view analysis, and identifying the one or morecharacters. In one aspect, the system further comprises a dataacquisition device. In another aspect, the system further comprisescomputer executable instructions for binarizing the character data,removing noise from the character data, and performing oblique/skewdetection. In another aspect, the system further comprises computerexecutable instructions for segmenting the character data intoindividual characters. In another aspect, the system further comprisescomputer executable instructions for identifying the one or morecharacters using an artificial neural network. In another aspect, thememory further comprises an artificial neural network.

The foregoing summary is illustrative only and is not intended to be inany way limiting. In addition to the illustrative aspects, embodiments,and features described above, further aspects, embodiments, and featureswill become apparent by reference to the drawings and the followingdetailed description.

BRIEF DESCRIPTION OF THE DRAWINGS

Features of the invention are shown in the drawings, in which likereference numerals designate like elements.

FIG. 1 is a schematic illustration defining four view directions: top,bottom, left, and right.

FIG. 2 is a schematic illustration of an example application of abounding box.

FIG. 3 is a schematic illustration of an example embodiment of a threelayer neural network.

FIG. 4 is a block diagram illustrating an embodiment of an examplesystem and method.

FIG. 5 illustrates (a) the Bengali letter “Auo” with matra on top of it,(b) the same letter having three logical horizontal segments, and (c)the same letter with characteristic points shown in each segment.

FIG. 6 is a schematic illustration of an embodiment of an example methodfor recognition of a compound character in which (a) is the compoundcharacter, (b) a first simple character, (c) a second simple character,and (d) the compound character with a divider to distinguish the simplecharacters.

FIG. 7 illustrates three compound characters from the Bengali language.

FIG. 8 illustrates an example use of a bounding box.

FIG. 9 shows a processing flow for an iterative histogram method, inaccordance with at least some embodiments described herein.

DETAILED DESCRIPTION

Character recognition of Asian languages is difficult. Conventionalcharacter recognition methods typically involve computations using everypixel that comprise the character. A large amount of memory is typicallyused. Further, using all of the pixels consumes valuable processor time.An embodiment disclosed herein use a lateral approach (explained in moredetail below) to character recognition. The lateral approach does notneed to use all of the pixels in a character. Indeed, as discussedbelow, acceptable character recognition may be performed with relativelyfew, representative data points.

An example character recognition method is substantially font invariant,fast, yet accurate. That is, the method works with a wide range of fontsfor a given language—fonts which share the same basic contour (radicallydecorative fonts pose recognition problems). Further, the method is notrestricted to any particular language or script. The method has beentested with Indian characters such as Bengali and Hindi, however it maybe used with any number of languages. Indeed, the method can easily beextended for the recognition of essentially any character in any script.

In contrast to conventional methods, an example embodiment of the methoduses a lateral-view based methodology for character recognition. Thelateral-view method uses data from the left and right contours of thecharacter. Experimental results have shown that correct characterrecognition can be accomplished with only partial information about theshape of the character. Characteristic points may be extracted from theleft and right contours of the individual letters to form acharacteristic feature vector. In an embodiment, the vector may be feedinto an Artificial Neural Network for classification/identification.

An embodiment relates to handwritten text recognition in handhelddevices such as but not limited to mobile phones, laptops, pdas, andmobile internet devices. This embodiment uses fewer resources in termsof computation time and memory relative to conventional methods ofhandwritten text recognition. This embodiment is handy for mobiledevices in which computations are typically made in a resourceconstrained environment. Because the present methods typically use onlya small number of representative points, the technique reduces storageused for character recognition. For example, after the characteristicvectors are generated, the original character image may be discarded.Reproduction of the original text can be made from the character vectorsas desired. Additionally, as discussed in more detail below, embodimentsof the method may be used for recognition of compound charactersprevalent in Bengali or Hindi type Asian languages.

As used herein the term “view” refers to a set of points from an outercontour of a character taken from a defined direction. Views may betaken from any number of different defined directions. Generally, fourviews are defined: top, bottom, left, and right. The four views areillustrated in FIG. 1 with reference to a capital letter “E.” The “topview” uses select points from the top contour of the character. The“bottom view” uses select points from the bottom contour of thecharacter. The “left view” uses select points from the left contour ofthe character, while the “right view” uses select points from the rightcontour of the character. The phrase “lateral view” refers to both theleft and right views. That is, both the left and right views are lateralviews.

A “bounding box” is an expression of the maximum extents of a2-dimensional object (e.g. character) within a 2 dimensional (x, y)coordinate system, in other words min(x), max(x), min(y), max(y). Thebounding box may be used as an indicator of the relative positions of afeature of a character. Each character within a given language may havea unique bounding box. Alternatively, the size of the bounding box maybe fixed (e.g., m×n) and the characters resized to fit the bounding box.FIG. 2 illustrates an example of the letter “Auo” from the Bengalilanguage surrounded by a bounding box, while FIG. 8 illustrates how thebounding box concept is used. An M×N background image is created. Afterputting the image into an m×n bounding box, the m×n bounding box issuperimposed on the M×N background as shown in FIG. 8. Typically, m<Mand n<N. The character may need to be scaled to fit into the m×n box.The M×N character is the final image on which the view-based analysis isapplied. The size of M×N and m×n boxes typically varies with thelanguage being recognized.

“Binarization” is the process of converting a scanned image havingmultiple colors (e.g., grey scale to full color) to a black-and-whiteformat. “Noise” may include, but is not limited to, smudges, spots,dirt, and other artifacts which are not intended to be part of thecharacter data. “Thinning” is a process by which a character is reducedto a skeleton by successively stripping away outer boundary pixels.“Skew” is a measure of angular misorientation of text from parallel forlanguages that are written horizontally.

“Segmentation” is a process by which text is divided into individualcharacters. The goal of segmentation is to simplify and/or change therepresentation of an image into something that is more meaningful andeasier to analyze. Image segmentation is typically used to locateobjects and boundaries (lines, curves, etc.) in images. As discussed inmore detail below, segmentation may be performed in a series of steps.That is, a page of text may be segmented into paragraphs, paragraphsinto sentences, sentences into words, and words into characters.Segmentation, however, need not be performed using all of the previoussteps. That is, one or more of the steps may be omitted.

A “neural network” is an interconnected group of nodes. FIG. 3 shows athree layer neural network. The first layer is the input later and thefinal layer is the output layer. Between the input and the output layeris a hidden layer. Optionally, there could be a plurality of hiddenlayers as desired. Inputs are given to the input layers from theexternal world. The neuron at the input layer makes a weighted sum andby using a transfer function, the neuron propagates the weighted sum tothe next level of neurons.

An “artificial neural network” is a mathematical model or computationalmodel that tries to simulate the structure and/or functional aspects ofbiological neural networks. Artificial neural networks can be made up ofinterconnecting artificial neurons (programming constructs that mimicthe properties of biological neurons). Artificial neural networks may beused to model complex relationships between inputs and outputs, to findpatterns in data, to gain an understanding of biological neuralnetworks, or for solving artificial intelligence problems withoutnecessarily creating a model of a real biological system.

Within such artificial neural networks, there are different learningparadigms, each corresponding to a particular abstract learning task.These are supervised learning, unsupervised learning and reinforcementlearning. There are a number of algorithms for training artificialneural networks. These algorithms may be viewed as an application ofoptimization theory and statistical estimation. Back propagation is anexample of one such algorithm.

Back propagation, or propagation of error, is a method of teachingartificial neural networks how to perform a given task. It is asupervised learning method, and is an implementation of the Delta rule.The algorithm relies on a teacher that knows, or can calculate, thedesired output for any given input. The back propagation method istypically used for feed-forward networks (networks that have nofeedback, or simply, that have no connections that loop).

Back propagation networks may be multilayer perceptions (a binaryclassifier that maps its input x (a real-valued vector) to an outputvalue f(x) (a single binary value) across the matrix), usually with oneinput, one hidden, and one output layer. Multilayer networks typicallyhave non-linear activation functions for the multiple layers. This isbecause a multilayer network using only linear activation functions isequivalent to a single layer, linear network. Non-linear activationfunctions that may be used include, but are not limited to, the logisticfunction, the softmax function, and the Gaussian function.

A block diagram of an example system and method 100 is shown in FIG. 4.In this embodiment, lateral view based character recognition includes ofthe steps of i) data acquisition 102, ii) text binarization and noiseremoval 104, iii) oblique/skew detection and removal 106, iv)segmentation 108, v) lateral view-based analysis and characteristicpoints selection of a character 110, vi) generation of a feature vector112, and vii) classification and recognition 116 with an ArtificialNeural Network 114. The Artificial Neural Network 114 includes training120, a knowledge base 118, and classification (pattern recognition) 116.The output is text recognition 122. Other embodiments may include fewersteps or additional steps. For example, if an electronic copy of thetext to be recognized is received, then the step of data acquisition 102by scanning may be omitted. Similarly, if the original text is black andwhite, binarization 104 may be omitted. If the original is clean, (i.e.,relatively noise free), noise removal may be omitted 104. Segmentation108 may, in some situations (for example analysis of a singlecharacter), be omitted. Optional steps that may be added include, forexample, thinning.

Data acquisition 102: In an embodiment, the data may be acquired 102 bybeing scanned by a scanning device, such as but not limited to flatbed,photo, handheld, digital camera, charged-coupled devices (CCDs), andcontact image sensors (CIS). The scanned data may then be stored indigital image format. Alternatively, the data may be stored in an analogformat and converted to a digital format later. The data may bedigitized and stored, for example, using a histogram thresholdtechnique. In the histogram threshold technique, individual pixels in animage are marked as “object” pixels if their value is greater than somethreshold value (assuming an object to be brighter than the background)and as “background” pixels otherwise. Other digital algorithms may alsobe used. Data may also be acquired by typing characters using a texteditor that supports the language/script and then taking an image of thecharacters.

Binarization and Noise removal 104: Binarization 104 is the process ofconverting a scanned image having multiple colors (e.g., grey scale tofull color) to a black-and-white format. The color of an image may haveno special significance for character recognition. Therefore, in anembodiment, if the scanned image includes color, the scanned image maybe converted into a binary (black and white) Image. Standard algorithmsfor binarization can be used for this purpose.

Otsu's method is an example image binarization method 104 that may beused to perform histogram shape-based image thresholding or, thereduction of a gray-level image to a binary image. The algorithm assumesthat the image to be binarized (thresholded) contains two classes ofpixels (e.g. foreground and background). The algorithm calculates theoptimum threshold separating those two classes so that their combinedspread (intra-class variance) is minimal.

In Otsu's method, the threshold that minimizes the intra-class varianceis first determined. The intra-class variance may be defined as aweighted sum of variances of the two classes:σ_(ω) ²(t)=ω₁(t)σ₁ ²(t)+ω₂(t)σ₂ ²(t)  (1)Where weights ω_(i) are the probabilities of the two classes separatedby a threshold t and σ_(i) ² are the variances of these classes.

The Otsu method illustrates that minimizing the intra-class variance isthe same as maximizing the inter-class variance:σ_(b) ²(t)=σ²−σ_(ω) ²(t)=ω₁(t)ω₂(t)[μ₁(t)−μ₂(t)]²  (2)Where the inter-class variance is expressed in terms of classprobabilities ω_(i) and class means μ_(i), which in turn can be updatediteratively. Otsu's method may be used by: (1) computing histogram andprobabilities of each intensity level, (2) setting up the initialω_(i)(O) and μ_(i)(O), (3) stepping through the thresholds t=1 . . .maximum intensity, (a) updating ω_(i) and μ_(i), (b) computing σ_(b)²(t), and (4) determining the threshold corresponding to the maximumσ_(b) ²(t). Binarization may also be accomplished with a histogramthreshold technique.

Example data sources for character recognition include printed or handwritten text; these data sources are susceptible to noise. Noise mayinclude, but is not limited to, smudges, spots, dirt, and otherartifacts which are not intended to be part of the character data. Noisydata can affect the final recognition process. For example, noise, maycause the system to choose an incorrect point as the characteristicpoint for the step of lateral analysis discussed below. There are somestandard methods for removing noise 104. For example, a Wiener Filter(using constant ratio/using auto correlation function) may be used toremove blurred noise from the image. Spatial filters like harmonicmean/contra harmonic mean etc may also be used. Various noise types likepepper/salt noise can be removed by applying the max/min filters. Noiseremoval is an overhead on character recognition processing. Thus, insome embodiments, noise is removed 104 from the image before furtherprocessing the image.

Oblique/skew detection and removal 106: When scanning a paper documentto convert it to an electronic form with digitizing devices (e.g., ascanner), the paper may be subject to a small tilt or skew. A de-skeweddocument, however, generally results in a more compact representation ofits components. Typically, the text and pictorial objects of a de-skeweddocument may be more clearly marked and identified by rectilinearbounding boxes. This may be particularly true for text objects, such asa paragraph of text, lines, words etc. A de-skewed document typicallyresults in more efficient, robust, and simpler algorithms for documentimage analysis such as optical character recognition (OCR).

Segmentation 108: In an embodiment, the text is segmented intoindividual characters. Improper character segmentation may produceincorrect characteristic points, leading to a wrong feature vector. Inan embodiment, if the input document contains a multi-line textconsisting of a number of words and characters, the system firstsegments the text to extract the individual lines. In a next step, thelines may be segmented into different words. At a next step of thesegmentation process, individual characters may be segmented from thewords.

Thresholding is a simple example method of image segmentation. From agrayscale image, thresholding can be used to create binary image. Ahistogram of the image pixel intensities may be created and the valleypoint used as the threshold. The histogram approach assumes that thereis some average value for the background and object pixels, but that theactual pixel values have some variation around these average values. Thehistogram approach may be computationally expensive. Additionally, someimage histograms may not have clearly defined valley points, oftenmaking the selection of an accurate threshold difficult. A variation 200of the histogram method that is relatively simple, does not require muchspecific knowledge of the image, and is robust against image noise,illustrated in FIG. 9, is the following iterative method:

201. An initial threshold (T) is chosen, this can be done randomly oraccording to any other method desired.

202. The image is segmented into object and background pixels asdescribed above, creating two sets:G ₁ ={f(m,n):f(m,n)>T}(object pixels)  (2.1)G ₂ ={f(m,n):f(m,n)≦T}(background pixels) (note, f(m,n) is the value ofthe pixel located in the m ^(th) column, n ^(th) row)  (2.2)

203. The average of each set is computed.m ₁=average value of G ₁  1.m ₂=average value of G ₂  2.

204. A new threshold is created that is the average of m₁ and m₂T′=(m ₁ +m ₂)/2  (4.1)

205. Return to step two, now using the new threshold computed in stepfour, keep repeating until the new threshold matches the one before it(i.e. until convergence has been reached).

Lateral-View-based Analysis and Characteristics Points Selection 110:The lateral view approach is based on the idea that the left and rightcontours of a character provide information that can be used torecognize the character. In an embodiment, two “views” (left and right)of each letter are examined to determine a characteristic feature vectorwhich describes the given letter. In an embodiment, the views includepixels belonging to the contour of a letter and having extreme values ofx coordinate—minimal for the left view and maximal for the right view(considering the image to be represented in the first quadrant of aCartesian coordinate system). That is, the origin of the Cartesiancoordinate is set at the lower left of the bounding box of the letter.In alternative embodiments, the origin may be set such that the letteris located in any of the other three Cartesian quadrants.

Characteristic points may be extracted from the lateral views of thecharacter (left and right views of individual letters). In an example,an embodiment is illustrated in FIG. 5 with a letter of Bengalilanguage. In this example, the character is a simple character. Compoundcharacters, however, may also be recognized as described in more detailbelow considered. In an embodiment, computation time is reduced relativeto conventional methods that use almost every pixel of the character. Inthis embodiment there is no need to use a brute force matching processthat compares each and every pixel of the image of the letter beingevaluated with the corresponding pixel of another image in a pre-storeddatabase. In this method, typically only a few points (from left andright contours/boundaries of the letter) are selected to form a set ofcharacteristic points that describe the character/letter.

In an embodiment, characteristic points are marked out on the surface ofthe left and right views to describe the shape of those views. Themethod of selecting these points and their amount may vary. Typically,the number of points is selected which results in a desired thresholdaccuracy of character recognition. In an embodiment, the more pointsthat are selected, the greater the accuracy. However, the selection ofmore points results in greater computation and slower text recognition.Thus, for example, the number of points used for a mobile device inwhich fast results are desired may be lower than the number of pointsused for scholarly research where high recognition accuracy is required.

To find the characteristic points of a character in one embodiment, theimage of the letter may be divided horizontally into a number ofidentical segments equal to the number of points to be considered forprocessing (FIG. 5 b). In other embodiments, the segments are notidentical. For example, if it is known that a particular language hasmore distinctive features in a lower portion of the characters than inhigher portions, than the segment sizes may be selected such that thereare more characteristic points generated in the lower portion of thecharacters.

Next, the position from the Y-axis of the nearest (left view) andfurthest (right view) points on the left and right contours of thecharacter in each segment is identified. In this manner, thecharacteristic point for each segment for both the left and right viewsis determined (FIG. 5 c). The two sets representing these characteristicpoints may be denoted as follows. The points taken from the left viewform the set Plv={(x1,y1), (x2,y2), (x3,y3)}. The points taken from theright view form the set Prv={(x′1,y′1), (x′2,y′2), (x′3,y′3)}.

As shown in FIG. 5, the letter “Auo” has been divided into threepartitions (FIG. 5 b). As discussed above, more or fewer partitions maybe selected depending on the complexity of the characters and thedesired accuracy. In this embodiment, one characteristic point isselected for each partition for both left and right views.Alternatively, more than one point may be selected for one or more ofthe partitions. From the three selected points, two 3-element vectorsdescribing the given letter may be generated:Vleft={x1,x2,x3}; and Vright={x′1,x′2,x′3}  (3)

Next, these two vectors together with two values describing the aspectratio of the picture (width, w by height, h) are transformed into asingle 8-element feature vector of the corresponding character. Theaspect ratio may be used to normalize the characters so that the samecharacter with different aspect ratio may be recognized without use ofmultiple reference vectors for each character. In this manner, differentdocuments having different font sizes may all be recognized with thesame reference vectors. Indeed, this embodiment may be used for example,with texts with different character sizes, such as newspapers thatinclude headlines or a document that includes headers.FV={x1,x′1,x2,x′2,x3,x′3,w,h}.  (4)

In the feature vector, the x-coordinates of the points have been orderedsegment wise, followed by the aspect ration. The first element of thisvector is the x-coordinate of the characteristic point in the firsthorizontal segment for the left view. The second element in the vectoris the x-coordinate of the characteristic point in the first segment forthe right view, etc. The ordering of the elements within the featurevector, however, is arbitrary. That is, for an embodiment, any order maybe selected.

Classification with Artificial Neural Network 114: In an embodiment, anartificial neural network may be used as the classifier (recognizer).Artificial Neural Networks 114 have been found to perform well as aclassifier in connection to optical character recognition. ArtificialNeural Networks 114 are developed by training 120 to develop a knowledgebase 118 which is used for classification (pattern recognition) 116.

Handling Compound Characters

A compound character is a character which comprises two or more simplecharacters. FIG. 6 a illustrates an example of a compound character inBengali. FIGS. 6 b and 6 c illustrate the two component charactersforming the compound character of FIG. 6 a. One approach to deal withthese types of compound characters is to diagonally segment thecharacter into two parts as shown in FIG. 6 d and identify the componentcharacters individually. Then the compound character may be recognizedfrom the individual component characters.

In an embodiment, recognition may be accomplished without diagonalsegmentation. The contours of such compound characters typically have acharacteristic pattern. Examples of three compound characters in Bengaliare illustrated in FIG. 7. Because these compound characters havedifferent contours, they can therefore be identified by view-basedanalysis without diagonal segmentation. This saves the computation timerequired for the diagonal segmentation.

In conventional character recognition algorithms, the computation isdone on scanned images stored in some format. In an embodiment of theproposed lateral view based approach, computation is done on theidentified feature vector, rather than the entire image. Thus, thefeature vector of the characters to be recognized may be stored ratherthan the whole picture/image or a thinned version of the image. Thisreduces the use of storage and tends to speed up the process ofcharacter recognition. In an embodiment, the lateral view based approachmay be used for languages/scripts that contain a horizontal line like“Matra” on top of the characters in word, e.g. Devanagri, Hindi, andBengali. A top-bottom view based approach may not properly classify suchcharacters as the top view is same for a large number of characters forsuch languages. Further, the lateral view methodology is good forclassification of the compound characters used in these languages.

The present disclosure is not to be limited in terms of the particularembodiments described in this application, which are intended asillustrations of various aspects. Many modifications and variations canbe made without departing from its spirit and scope, as will be apparentto those skilled in the art. Functionally equivalent methods andapparatuses within the scope of the disclosure, in addition to thoseenumerated herein, will be apparent to those skilled in the art from theforegoing descriptions. Such modifications and variations are intendedto fall within the scope of the appended claims. The present disclosureis to be limited only by the terms of the appended claims, along withthe full scope of equivalents to which such claims are entitled. It isto be understood that this disclosure is not limited to particularmethods, reagents, compounds compositions or biological systems, whichcan, of course, vary. It is also to be understood that the terminologyused herein is for the purpose of describing particular embodimentsonly, and is not intended to be limiting.

With respect to the use of substantially any plural and/or singularterms herein, those having skill in the art can translate from theplural to the singular and/or from the singular to the plural as isappropriate to the context and/or application. The varioussingular/plural permutations may be expressly set forth herein for sakeof clarity.

It will be understood by those within the art that, in general, termsused herein, and especially in the appended claims (e.g., bodies of theappended claims) are generally intended as “open” terms (e.g., the term“including” should be interpreted as “including but not limited to,” theterm “having” should be interpreted as “having at least,” the term“includes” should be interpreted as “includes but is not limited to,”etc.). It will be further understood by those within the art that if aspecific number of an introduced claim recitation is intended, such anintent will be explicitly recited in the claim, and in the absence ofsuch recitation no such intent is present. For example, as an aid tounderstanding, the following appended claims may contain usage of theintroductory phrases “at least one” and “one or more” to introduce claimrecitations. However, the use of such phrases should not be construed toimply that the introduction of a claim recitation by the indefinitearticles “a” or “an” limits any particular claim containing suchintroduced claim recitation to embodiments containing only one suchrecitation, even when the same claim includes the introductory phrases“one or more” or “at least one” and indefinite articles such as “a” or“an” (e.g., “a” and/or “an” should be interpreted to mean “at least one”or “one or more”); the same holds true for the use of definite articlesused to introduce claim recitations. In addition, even if a specificnumber of an introduced claim recitation is explicitly recited, thoseskilled in the art will recognize that such recitation should beinterpreted to mean at least the recited number (e.g., the barerecitation of “two recitations,” without other modifiers, means at leasttwo recitations, or two or more recitations). Furthermore, in thoseinstances where a convention analogous to “at least one of A, B, and C,etc.” is used, in general such a construction is intended in the senseone having skill in the art would understand the convention (e.g., “asystem having at least one of A, B, and C” would include but not belimited to systems that have A alone, B alone, C alone, A and Btogether, A and C together, B and C together, and/or A, B, and Ctogether, etc.). In those instances where a convention analogous to “atleast one of A, B, or C, etc.” is used, in general such a constructionis intended in the sense one having skill in the art would understandthe convention (e.g., “a system having at least one of A, B, or C” wouldinclude but not be limited to systems that have A alone, B alone, Calone, A and B together, A and C together, B and C together, and/or A,B, and C together, etc.). It will be further understood by those withinthe art that virtually any disjunctive word and/or phrase presenting twoor more alternative terms, whether in the description, claims, ordrawings, should be understood to contemplate the possibilities ofincluding one of the terms, either of the terms, or both terms. Forexample, the phrase “A or B” will be understood to include thepossibilities of “A” or “B” or “A and B.”

In addition, where features or aspects of the disclosure are describedin terms of Markush groups, those skilled in the art will recognize thatthe disclosure is also thereby described in terms of any individualmember or subgroup of members of the Markush group.

As will be understood by one skilled in the art, for any and allpurposes, such as in terms of providing a written description, allranges disclosed herein also encompass any and all possible subrangesand combinations of subranges thereof. Any listed range can be easilyrecognized as sufficiently describing and enabling the same range beingbroken down into at least equal halves, thirds, quarters, fifths,tenths, etc. As a non-limiting example, each range discussed herein canbe readily broken down into a lower third, middle third and upper third,etc. As will also be understood by one skilled in the art all languagesuch as “up to,” “at least,” “greater than,” “less than,” and the likeinclude the number recited and refer to ranges which can be subsequentlybroken down into subranges as discussed above. Finally, as will beunderstood by one skilled in the art, a range includes each individualmember. Thus, for example, a group having 1-3 cells refers to groupshaving 1, 2, or 3 cells. Similarly, a group having 1-5 cells refers togroups having 1, 2, 3, 4, or 5 cells, and so forth.

While various aspects and embodiments have been disclosed herein, otheraspects and embodiments will be apparent to those skilled in the art.The various aspects and embodiments disclosed herein are for purposes ofillustration and are not intended to be limiting, with the true scopeand spirit being indicated by the following claims.

What is claimed:
 1. A device comprising: a data acquisition deviceconfigured to acquire character data comprising one or more characters,the one or more characters having a first contour and a second contour;and a computing device configured to: perform lateral view analysis onthe character data, the lateral view analysis comprising locatingcharacteristic points on the first and second contours, includingdividing the one or more characters into segments of more than one size,wherein a characteristic point is located in each segment on the firstcontour and the second contour; identify the one or more charactersbased on the lateral view analysis.
 2. The device of claim 1, whereinthe segments and the characteristic points are equal in number; andwherein a number of characteristic points at relatively lower portionsof the one or more characters is greater than a number of characteristicpoints at relatively higher portions of the one or more characters. 3.The device of claim 1, wherein the device is a mobile device.
 4. Thedevice of claim 1, wherein the device is a smartphone.
 5. The device ofclaim 1, wherein performing the lateral view analysis on the characterdata includes locating characteristic points on the first and secondcontours of a character of the one or more characters, includingdividing the character into segments of more than one size, wherein acharacteristic point is located in each segment on the first contour andthe second contour of the character; wherein the computing device isfurther configured to generate a feature vector of the character basedon the lateral view analysis; wherein identifying the one or morecharacters includes identifying the character based on the featurevector; and wherein the feature vector comprises: a minimum distance ofcharacteristic points on the first contour of the character; a maximumdistance of characteristic points on the second contour of thecharacter; a width of the character; and a height of the character. 6.The device of claim 1, wherein the one or more characters comprisecharacters of a language script written vertically.
 7. The device ofclaim 1, wherein the one or more characters comprise characters of alanguage that uses Matra.
 8. A device comprising: a data acquisitiondevice configured to acquire character data comprising one or morecompound characters; and a computing device configured to: divide eachof the one or more compound characters diagonally into two or morecomponent characters, each of the two or more component charactershaving a first contour and a second contour; perform lateral viewanalysis on character data of the two or more component characters fromthe character data of the one or more compound characters, the lateralview analysis comprising locating characteristic points on the first andsecond contours of each of the two or more component characters,including dividing the two or more component characters into segments,wherein a characteristic point is located in each segment on the firstcontour and the second contour; identify the two or more componentcharacters based on the lateral view analysis; and identify the one ormore compound characters from the identified two or more componentcharacters.
 9. The device of claim 8, wherein the segments and thecharacteristic points are equal in number; and wherein a number ofcharacteristic points at relatively lower portions of the two or morecomponent characters is greater than a number of characteristic pointsat relatively higher portions of the two or more component characters.10. The device of claim 8, wherein the device is a mobile device. 11.The device of claim 8, wherein the device is a smartphone.
 12. Thedevice of claim 8, wherein performing the lateral view analysis on thecharacter data of the two or more component characters includes locatingcharacteristic points on the first and second contours of first andsecond component characters of the two or more component characters,including dividing each of the first and second component charactersinto segments, wherein a characteristic point is located in each segmenton the first contour and the second contour of each of the first andsecond component characters; wherein the computing device is furtherconfigured to generate a feature vector of each of the first and secondcomponent characters based on the lateral view analysis; whereinidentifying the first and second component characters is based on thefeature vector of each of the first and second component characters,respectively; and wherein each of the feature vectors comprises: aminimum distance of characteristic points on the first contour of thecomponent character corresponding to the feature vector; a maximumdistance of characteristic points on the second contour of thecorresponding component character; a width of the correspondingcomponent character; and a height of the corresponding componentcharacter.
 13. The device of claim 8, wherein the one or more compoundcharacters comprise compound characters of a language script writtenvertically.
 14. The device of claim 8, wherein the one or more compoundcharacters comprise compound characters of a language that uses Matra.15. A method comprising: receiving, by a device, character datacomprising one or more characters; performing, by the device, lateralview analysis on the character data, including dividing the one or morecharacters into segments of more than one size; and identifying, by thedevice, the one or more characters based on the lateral view analysis.16. The method of claim 15, wherein the one or more characters have afirst contour and a second contour; wherein performing lateral analysisfurther comprises locating characteristic points on the first and secondcontours; and wherein a characteristic point is located in each segmenton the first contour and the second contour.
 17. The method of claim 15,wherein the one or more characters have a first contour and a secondcontour; wherein performing lateral analysis further comprises locatingcharacteristic points on the first and second contours, wherein acharacteristic point is located in each segment on the first contour andthe second contour; wherein the segments and the characteristic pointsare equal in number; and wherein a number of characteristic points atrelatively lower portions of the one or more characters is greater thana number of characteristic points at relatively higher portions of theone or more characters.
 18. The method of claim 15, wherein the deviceis a mobile device.
 19. The method of claim 15, wherein the device is asmartphone.
 20. The method of claim 15, wherein the one or morecharacters have a first contour and a second contour; wherein performingthe lateral view analysis on the character data comprises: locatingcharacteristic points on the first and second contours of a character ofthe one or more characters; and dividing the character into segments ofmore than one size, wherein a characteristic point is located in eachsegment on the first contour and the second contour of the character;wherein the method further comprises: generating, by the device, afeature vector of the character based on the lateral view analysis;wherein identifying the one or more characters includes identifying thecharacter based on the feature vector; and wherein the feature vectorcomprises: a minimum distance of characteristic points on the firstcontour of the character; a maximum distance of characteristic points onthe second contour of the character; a width of the character; and aheight of the character.
 21. The method of claim 15, wherein the one ormore characters comprise characters of a language script writtenvertically.
 22. The method of claim 15, wherein the one or morecharacters comprise characters of a language that uses Matra.